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Abstract 

We investigate a Bahadur- Kiefer type representation for the p n -th empirical 
quantile corresponding to a sample of n i.i.d. random variables, when p n E (0,1) 
is a sequence which, in particular, may tend to or 1, i.e. we consider the case of 
intermediate sample quantiles. We obtain an 'in probability ' version of the Bahadur 

- Kiefer type representation for a k n -th order statistic when r n — k n A(n — k n ) — > oo 
under some mild regularity conditions, and an 'almost sure ' version under additional 
assumption that log n/r n —tQ,n—> oo. A representation for the sum of order 
statistics laying between the population p n - quantile and the corresponding empirical 
quantile is also established. 
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1 Introduction 



The classical Bahadur - Kiefer representation was established by Bahadur pQ and Kiefer 
P3]-[l5], it allows one to replace the quantile process by (-1) times the empirical process 
with an almost sure uniform error of the order n~ l / A+ °^ l \ where n is the real i.i.d. data 
sample size (see, e.g., Shorack and Wellner [19] . Deheuvels and Mason [6], Deheuvels 
[3], see also references therein). 

In this paper we investigate the asymptotic behavior of the so-called intermediate 
sample quantile, i.e. of the A: n -th order statistic, 1 < k n < n, when r n : = k n A (n — 
k n ) — > oo, p n : = k n /n — » (or p n — > 1), as n — > oo. We obtain Bahadur-Kiefer type 
representations for intermediate sample quantiles under a mild regularity condition, 
and we establish also a representation for sum of the order statistics laying between the 
population p n -th quantile and the corresponding sample quantile. 

Consider a sequence Xi,X%, ... of independent identically distributed (i.i.d.) real- 
valued random variables (r.v.) with common distribution function (df) F, and for each 
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integer n > 1 let X\- n < • • • < X n:n denote the order statistics based on the sample 
Zi,...,X n . Let = inf{ar : F(x) > u}, < u < 1, F _1 (0) = i^O 4 "), denote 

the left-continuous inverse function of F, and F n , F" 1 — the empirical df and its 
inverse respectively, put / = F' to be a density of the underlying distribution when it 
exists. Let £ p = F~ l {p), ^ pn:n = F~ 1 (p) denote p-th population and sample quantile 
respectively. 

For a fixed p £ (0, 1) assuming that F has at least two continuous derivatives in 
a neighborhood of £ p and f(C P ) > 0, Bahadur [lj first establish the almost sure result: 

C P n:n = Cp- Fn{ ^~ P +Rn(p), (1-1) 

where R n {p) = O a . s , (ra _3/,4 (log n) 1 / 2 (log log ra) 1 / 4 ) (a sequence of random variables 
R n is said to be O a .s.( T n) if Rn/^n is almost surely bounded). Kiefer in a se- 
quence of papers [l3]-[15] proved that if /' is bounded in a neighborhood of p and 
f(Q > 0, then limsup n ^ 00 ±n 3 / 4 (loglogn)- 3 / 4 J R n (p) = a^a-^gi-p)) 1 /* a.s. for 
either choice of sign. In Reiss [T7J a version of Bahadur's result with a remainder 
term, which is of the order O (log n/n) 3 / 4 in probability was obtained: if the density 
/ = F' is Lipschitz in a neighborhood of p and > 0, then holds true and 

-P(|-R ra (p)| > ^4(log n/n) 3 / 4 ) < Bn~ c for every c > 0, where ^4,23 are some positive 
constants, not depending on n. 

Our interest in Bahadur-Kiefer type representation for intermediate empirical quan- 
tile was first motivated by its uses in the second order asymptotic analysis of trimmed 
sums. It turns out (see Gribkova and Helmers [7J -[9]) that the Bahadur - Kiefer prop- 
erties provide a very useful tool in investigation of the asymptotic behavior of the 
distributions of trimmed sums of i.i.d. r.v.'s, slightly trimmed sums and their stu- 
dentized versions. In particular, the Bahadur's representation allows us to construct 
a [/-statistics type stochastic approximation for these statistics, which will enable us 
to establish the Berry - Esseen type bounds and the Edgeworth expansions in Central 
Limit Theorems for normalized and studentized slightly trimmed sums. 

We would like to emphasize, that the Bahadur-Kiefer type representation we ob- 
tain for a sum of order statistics lying between the p^-th population quantile and the 
corresponding empirical quantile (cf. Theorem I2.2p . is especially useful in the construc- 
tion of the [/-statistic type approximation for a (slightly) trimmed sum, as it provides 
a quadratic term of the desired [/-statistic. Note also that formally the representa- 
tion (|2.7p (cf. Theorem I2.2[) can be obtained by integrating of the corresponding Ba- 
hadur - Kiefer process in interval [£ Pn n:n> £p„); however we prove representation (|2.7p 
for intermediate order statistics (i.e. when p n — > (or p n — > 1). The remainder terms 
in our representations are shown to be of a suitable order of magnitude similar as in 
Reiss [17] . 

Part of our results can be compared with an earlier result obtained by Chanda [3] , 
who established the Bahadur - Kiefer representation for the intermediate fc n -th order 
statistics, assuming the somewhat restrictive condition n a /k n — > for some a > and, 
in addition, some strong regularity conditions on F must be satisfied. 

We conclude this introduction by noting that some extensions of Bahadur's result to 
dependent random variables have been proved by Sen [18] (cf. also Wu [H]). The validity 
of Bahadur's representation for a bootstrapped p-quantile was proved (as an auxiliary 
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result) in Gribkova and Helmers [8]. Deheuvels [5] established a multivariate Bahadur- 
Kiefer representation for the empirical copula process. 



2 Statement of results 

Let k n be a sequences of integers, such that < k n < n, and r n = k n A (1 — k n ) — > oo, 
as n -s> oo. Put p n = k n /n, and let £ Pn = F _1 (p n ), £ Pnn:n = F~ 1 {p n ) denote p n -th 
population and empirical quantile respectively. 
Define two numbers 

< a\ = liminf p n < a 2 = limsup p n < 1. (2-1) 

>oo n— !>oo 

We will assume throughout this note that the following smoothness condition is satisfied. 

[A\\. The function i 7-1 is differentiable in some open set U C (0,1) (i.e. the density 
f = F' exists and is positive in F~ l {U)), moreover 

(0,e), if = ai = a2, (l-e,l), if ai = a 2 = 1, 

U D (0,a 2 ] i/ = ai < a 2 , C/ D [ai,l), if < ai < a 2 = 1, 

[ai,a 2 ], i/ < ai < a 2 < 1, (0,1), ?/ ai = 0, a 2 = 1, 

(2.2) 

some < e < 1 in cases given in the first lines of ()2.2[) J. 
To state our results we will need also the following condition: 

L4 2 ]. r~ l \ogn— > 0, n — > oo. 

Let ft be a real- valued function defined on the set i ?_1 (C7) (cf. (|2.2p ). Take an 
arbitrary < C < oo and for all sufficiently large n define 



(2.3) 



\t\<C 

where h o = ft Note that P« + ^ r "'°f r " = + t x/^ 2 

Pn + t^ o(l), n — )• oo. In particular, this implies that the function introduced in 
is well-defined for all sufficiently large n. 

Next we define a function ^ Pn: h{C) which is equal to ^> Pn: h{C), where logr n is 
replaced by logn. Similarly as before we show that it is well-defined for all sufficiently 
large n if condition L4 2 ] holds true. 

We will obtain the Bahadur-Kiefer type representations for some smooth function of 
the empirical quantile, as it turned out (cf. [7]- [9]) that these extensions are very useful 
in construction of the [/-statistic type stochastic approximations for the trimmed sums. 

Let G(x), x € R, be a real- valued function, g = G' - its derivative when it exists, and 
let (g/f)(x) and (\g\/ f)(x) denote the ratios g(x)/ f(x) and \g(x)\/ f(x) respectively. 

Theorem 2.1 Suppose that r n — > oo, as n — >■ oo ; the condition [Ai] holds true and G 
is differentiable on the set i 7-1 ([/"). Then 

G(i Pnn .. n ) - G{i pn ) = -[F n {i pn ) - F^^Mpn) + Rn(Pn), (2.4) 
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where for each c > 

P(\R n (p n )\> A n ) = 0(r- c ), (2.5) 

with 

A n = A( Pn (l - ftO)V4 (^) 3/4 ^(e P J -Pn)) 1 / 2 (^) 1/2 ^,f 

where A, B and C are some positive constants, which depend only on c. 

Moreover, if additionally the condition [A2] is also satisfied, then (|2.4p holds true 
and 

P(\Rn(p n )\ > A n ) = O (n~ c ) , (2.6) 

for each c > with 

K = a ( Pn (i - Pn) )^ (^) 3/4 M^j + B {Pn{1 _ Pn)) v2 1/2 $ M 

where A, B and C are some positive constants, which depend only on c. 

Theorem 12.11 is a Bahadur-Kiefer type result. For the special case when < p < 1 
is fixed it is stated in Lemma 3.1 of [7] (cf. also Lemma 4.1, [8] and Reiss |17j). 



Remark 2.1 It is easy to see that if one compares the first term on the r.h.s. of ([27 
and the orders of magnitude of the quantities A n , A n given in (j2.5|) — (12. 6p that relation 
(|2.4p provides a representation with a remainder term R n (p n ) of smaller order than the 
first term if and only «/* Pn ,£ (C) = o(^(£ p J) and $ Pn £ (C) = o(^(f p J) for every 
fixed C > 0, as n — > 00. TTie same remark is valid for the two assertions stated in 
Theorem \2.2\ below. 

We relegate proofs of our results to sections [3] - [U 

Theorem 2.2 Suppose that r n — > 00, as n —> 00, the condition [Ai] holds true and G 
is differentiable on the set F -1 ([/"). Then 



I"" (G(x) - G{i Pn ))dF n {x) = ~[F n (C Pn ) - F(£ p J] 2 |(£ p J + Rn(Pn), (2.7) 



where 

P(\Rn(Pn)\ > A n ) = 0(r- c ), (2.8) 

for each c > with 

A n = A{p n {l-p n )fl± (^) 5/4 ^feJ + B Pn {l -Pn)^% n4 (C), 

where A, B and C are some positive constants, which depend only on c. 

Moreover, if additionally the condition [A%] is also satisfied, then (j2.4j) holds true, 

and 

P(\Rn(p n )\ > A n ) = 0{n- c ) (2.9) 

for each c > with 

A n = A (p n (l - Pn )f* (^) V4 ] -f(U + B Pn (l - Pn) l -^% n , f (C), 
where A, B and C are some positive constants, which depend only on c. 
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Theorem 12,21 extends Lemma 4.3 from [8] (cf. also Lemma 3.2, [7]), where it was 
proved for a fixed p to the case that p n is a sequence which may tend to or to 
1. Note also that if both conditions [Ai] and [A2] are satisfied, then Theorems I2.U — 
12.21 and an application of the Borel-Cantelly lemma imply an almost sure result, i.e. 

RniPn) = Oa.s.(A„), as n -> DO. 

Next we will state some consequences of the Theorems 12 . 11 — [2~2l where the remainder 
terms are given in simpler form. Our first two consequences concern the Bahadur-Kiefer 
type representations for the central (not intermediate) order statistics. 

Corollary 2.1 Suppose that < a± < a<i < 1, the condition [A\\ holds true and the 
functions f = F' and g = G' satisfies a Holder condition of the order a > 1/2 on the 
set F~ l (U). Then ([23]) is valid and P(\R n (p n )\ > A(logn/n) 3 / 4 ) = O (n~ c ) for each 
c > 0, where A > is some constant, not depending on n. 

Corollary 2.2 Suppose that the conditions of the Corollary \2.1\ are satisfied. Then 
fl2HD is valid and P(\R n (p n )\ > A(log n/n) 5 / 4 ) = O (n~ c ) for each c> 0, where A > 
is some constant, not depending on n. 

To prove Corollaries 12.11 — [2721 it suffices to note that the condition < a% < 02 < 1 
implies that [A2] is automatically satisfied, moreover, due to condition [Ai] the density 
/ is bounded away from zero on the set F~ 1 ([ai — 5, 02 + 5]) with some S > 0, and 
hence, the ratio gj f satisfies a Holder condition of the order a > 1/2 on this set. Then 
an application of Holder's condition to the function ^ Pn ,j (C) (cf- (|2.3p ) proves both 
corollaries. 

Next we state several corollaries for the intermediate sample quantiles provided some 
regularity conditions are satisfied. 

Note that the second terms of A n and A n in (I2.5p - (l2.6j) and in (|2.8j) - (12.9j) . involving 
the functions ^ Pni s (C) and ^ p a. (C), depend on the asymptotic properties of the ratio 
g/f, and we can describe some sets of conditions allowing to absorb these second terms 
in the first ones. We will need the following conditions: 

w »m < c > - ° ((^r^o ' <*> *m ^ - ° ((^) 1/4 ^^)) ■ 

(2.10) 

We preface a formulation of the corollaries of Theorems 12. 11 — [2721 with a stating of 
two its direct consequence under conditions (|2.10p . 

Theorem 2.3 Suppose that r n — > 00, as n — > 00, the condition [A\] holds true and G 

is differentiate on the set i ?_1 (?7). Assume in the addition that the condition (i) in 

(|2.10p holds true. Then the representation (|2.4|) and the relation (|2.5p are valid together 

/j n 3/4 I I 

with A n = A(p n (l — Pn)) 1 ' 4 ( ° „ r " ) j(?p„), where A is some positive constant not 
depending on n. 

Moreover, if additionally the condition [A2} and relation (ii) in (|2,10p are satisfied, 
then (|23D and are valid with A n = A (p n (l - p n )) l / A (^) 3/4 yfej- 

Theorem 2.4 Suppose that r n — > 00, as n — > 00, the condition [A\\ holds true and G 
is differentiable on the set i ?_1 (?7). Assume in the addition that the condition (i) in 
(I2.10P holds true. Then the representation (|2.7p and the relation (12. 8D are valid together 
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with A n = A(p n (l — p n )) 3//4 ( lo g J n ) ^(^Pn)j where A is some positive constant not 
depending on n. 

Moreover, if additionally the condition [A2] and the relation (ii) in (12,101) are sat- 
isfied, then £LID and $L9$) are valid with A n = A (p n (l - p„)) 3 / 4 l -f(C Pn ). 



Now we expose certain sets of conditions sufficient for the relations (I2.10p and obtain 
some corollaries of Theorems 12.31 — [2~4"1 

Let SRV p + °° (SRV~°°) be a class of regularly varying in +00 (—00) functions: 
g G SRV+°° (SRV~°°) «4> (i) g(x) = ±\x\ p L(x), for \x\ > x , with some x > 
(a?o < 0), p G R, and L(x) is a positive slowly varying function at +00 (—00); (ii) the 
following second order regularity condition on the tails is satisfied 



g(x + Ax) - g(x) = o(\g(x)\ — ' 



1/2N 



(2.11) 



L(x+Ax) 



1 



o 



Ax 



1/2 



as x 



+00 



when Ax = o(|x|), as x — >• +00 (x — > —00) 

Note that (j2TTj) holds true for 5 if 
(x — > —00), where L is the corresponding slowly varying function, and it is satisfied 
(even with degree 1 instead of 1/2) if L is continuously differentiable for sufficiently 

large |x| and |£'(x)| = O (^rp)> as 1 ^ +00 (x — > —00), which is valid for instance 
when L is some power of the logarithm. 

Corollary 2.3 Suppose that p n — > (p n — > 1), condition [Ai] is satisfied, f G SRV~°° 
(f G SRV+°°), where p = -(1 +7), 7 > 0, and g G SRV' 00 (g G SRV+°°), where 
p G M. T/ien £/ie condition (i) in (|2.10p is satisfied, and if additionally [A2] holds true, 
then the condition (ii) ( cf. (|2.10p J is a/so satisfied. Hence, both assertions stated in 
Theorems \2. 3\—\2.A\ are valid. 



We relegate the proof of the Corollary 12.31 to the section [5j 

Our final corollary concerns the case when the df F and the function G are twice 
differentiable. 

Let us define a function v(u) = % o F~ x (u), u G (0, 1). 

Corollary 2.4 Suppose that p n — > (p n — > lj, condition [A\] is satisfied, and assume 
that the functions f, g are differentiable on the set i ?_1 (C7). In the addition suppose 
that 

v'(u) [u A (1 - it)] 



and i/iai 



sup 



lim sup 



v(«) 
v (u + [u A (1 



< 00, 



0]o(l)) 



v(«) 



< 00, 



(2.12) 



(2.13) 



where o(l) denotes any function tending to zero when u \. (u f 1). 

T/ien i/ie condition (i) in (|2.10|) is satisfied, and if additionally [A2] holds true, 
then the condition (ii) ( cf. (12.10p J is ako satisfied. Hence, both assertions stated in 
Theorems \2.3\—{2~4\ are valid. 
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Proof. The proof of the corollary 12.41 is straightforward. Take an arbitrary C > 0, fix t : 
\t\ < C, and put a(n) = \J lo f rn when we prove relation (i) of (|2.10p . and a{n) = y^l^ 
when we prove relation (ii) of (|2.10p (under additional condition LA2]). In both cases 
we have a(n) — > 0, as n — > 00. Consider \v(p n + t[p n A (1 — p n )]a(n)) — v(p n )\. Since 
for all sufficiently large n p n and p n + t[p n A (1 — p n )]a(n) belong to the set U, the 
latter quantity is equal 



\ v (Pn)\ 



v'(p n + et\p n A (1 -p n )]a{n)) 



v (p n + 9t[p n A (1 - p n )]a(n)) 
v (p n + 0t\p n A (1 - p n )]a(n)) 



V(j>r, 



t [p n A (1 -p n )]a{n 
= 0(\v(p n )\a(n 



(2.14) 



what yields (|2.10p . The corollary is proved. □ 

The following examples show that the conditions (|2.12p and f)2. 13j) hold true in 
a number of interesting cases. 

Example 2.1 (Gumbel) Consider a distribution F(x) = exp(— exp(— x)), x 6 M, 
and let g(x) = x k , where k € Z = {0, ±1, ±2, . . . }. We take k integer only to 
avoid some problems of the existence for negative x. In this case we have f{x) = 
exp(— x) exp(— exp(— x)), for the inverse function we have F _1 (u) = — log(— log it), 

u € (0,1). In this case we obtain f(F~ 1 (u)) = —u logu, and v(u) = - — — log 
After simple computations we obtain 



-U logM 



v'(u) [u A (1 - u)] 



-k- 



uA (1 



u 



+ 



u A (1 



l + logu) 



(2.15) 



If u 

term tends to 
-k l ~ u 



v (u) — log(— logn) u log u — u logu 

0, the first term at the r.h.s in (12.15P tends to zero and the second 
-1. When u —¥ 1 we obtain that the first term is equivalent 

k l - 

'og(- log u) 

[0,e] ( Pn 0; 



1 i n — ; — r — rr " 7 — — 1 v = o(l). The second term is equivalent —r—^ 

log(— log u) log(l+(u— 1) log (— logu) K ' * logu 

" _l — 1 * o(l). Thus, (12.121) is satisfied in both cases U 



1 ). The check (I2.13P we write - + ^ ~ ' ~ 



log(l+(«-l)) 

and C/ = [1 — e, 1] (p„ 

log(-log(ix+[ixA(l-tt)]o(l))) 
log(- logn) 

tain taai the latter quantity is 1 + o(l), as u — > and as u — > 1 as well. 
Example 2.2 Let F(x) = (1 - exp(-x 7 )) I(x > 0), 7 > 0, and let g{x) 



u+[uA(i-u)\oii) log(n+[nA(i-.)]o(i)) > and ar 9 mn 9 ™ before we ob- 



P € 



iVow we get F l (u) = [— log(l — n)] 1 / 7 , n G (0, 1), and v (n) 
i[-log(l -n)]^ 1 )/ 7 - 1 ^. T/ien we obtain 

v '(u) [jiA(l-ti)] p + l-7 uA(l-u) 



-log(l-u)]P/T 

7[- log(l-u)](T- 1 )/T(l-M) 



n A (1 



v(u) 



7 



'1 — u) log(l — n) 



u 



(2.16) 



T/ie /zrst tarm on the r.h.s in (|2.16p tends to the constant 



p+1-7 

7 



waen u — >• and it 

tends to zero when u —¥ 1, tae second term tends to zero, as u — > and tends to 1, as 
u — )• 1. Thus, (|2.12p is satisfied in both cases as in previous example. The check (|2. 13[) 



we write 



V 1 «+ 



;«a(i-u)]o(i)) 



-(«) 



log(l-M-[MA(l-«)]o(l)) 

log(l-u) 



-1 



l-u-[uA(l- U )jo(l) • The Sim P le 

and as 



computations show that both factors of the latter quantity tends to 1, as u 
u -> 1. 
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Example 2.3 (Weibull) Let F(x) = exp(-x~^)I(x > 0), 7 > 0, and let g{x) = x p , 
pel. Here we getF- l {u) = [-logu]' 1 ^ , u G (0,1), f(F^ 1 (u)) = j(- log u)^ +1 Vi u, 
andv(u) = -J=^Sg^- = I[-log(l - u )]-(p+t+i)/t I. Then we ohtam 



7[- log u](t+i)/7 u 7 I 

v'(«)[«A(l-u)] p + 7 + 1 uA(l-u) uA(l-u) 
v (n) 7 ix log u u 



(2.17) 



// u — > 0, i/ie /irsi term on i/te r./i.s in (|2.17p tends to zero and i/ie second one tends 
to —1, and when u — > 1, the first term tends to the constant P+ J^~ l and the second one 
tends to zero. Thus, (|2.12p is satisfied in both cases u — >■ 0, 11 — ¥ 1. The check (|2.13p we 



v (m+[mA(1-u)]o(1)) 



write i—r 

v(u) 



log(u+[uA(l-u)]o(l)) 



P+7+1 



arguments show that both factors here tends to 1, as u — > and as u — > 1. 

Example 2.4 Lei C 7 exp(— |x| 7 ), 7 > 0, where C 7 is a constant, depending only on 7, 
and Ze£ ^(x) = ±|x| p , p € R. i£ is clear that the asymptotic behavior of the functions at 
the l.h.s.'s in conditions ()2. 12[) and (|2.13p are similar as in example \2.2\ (u — > 1). So, 
these conditions are also satisfied. 

Example 2.5 Here we consider an example of a distribution with super heavy tails, 
having no finite moments. In this case some difficulties arise, nevertheless the Bahadur 
- Kiefer representations (|2.4p - (j2.7p are still valid for the intermediate sample quantiles 
under some additional conditions. 

Let F(x) = 1 — for x > xq > 0, where C > is some constant. Suppose for ease 
of presentation that p n — > 1, as n — > 00, while r n = n — k n — > 00, and let g(x) = x p , 
p € R, though this will not influence the basic outline of our results. 

In this case i ?_1 (n) = exp( T ^), f(F~ 1 (u)) = { -^- exp , v(«) = 

exp {(p + 1) (1-u)' 2 • ^nce - > 1) we are interested only in the case u — > 1, 
so m A (1 - «) = 1 - u, and a/tor simple computations we obtain 

v'(n)(l-u) C(p + 1) 



v (it) 1 — It 



+ 2, (2.18) 



u>aai is not bounded as u — > 1, and therefore (|2.12p is clearly not satisfied. The compu- 
tations of the magnitude on the l.h.s. in (|2.13|) yields 

v (n + [n A (1 — w)lo(l)) / , N o(l) \ , 

1 -exp C(p + 1)-^ (l + o(l)). (2.19) 



v (nj \ 1 — n 

W^e conclude that (I2.13P is satisfied only if ~~ 0, as n — )• 1. However, we apply 
our conditions for a sequence with u = p n (cf. proof of the Corollary \2.J$ . So, 1 — u = 

1 — Pn, the quantity o(l) is a(n) = ^J lo f Tn (cf. (|2.14j) J, where r n = k n A (n — fc n ) fand 
r n = n — k n for all sufficiently large n,as p n — > 1). Although the relations (|2.10p are not 
valid more in our example, we can achieve a weaker relation ^ Pn x (C) = o0y-(^ Pn )), 
guaranteeing that (|2.4p and (|2.7p are representations (cf. Remark \2.1\) . Observe that 
(|2.14p (c/. the proof of Corollary \2.J$ and (|2.18p - (|2.19p together imply that we need only 
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that = v/^f^ ^ = o(l), as n -> oo. 27ws, tfie representations ([231) « nd dSTTJ) 
are va/id /or the intermediate sample quantiles in this example if 

>■ U, as n — > oo. 

Define a binomial r.v. N p = : Xi < < p < 1. Our proof of Theorems I2.U 
12.21 uses the following fact: conditionally on N p the order statistics Xj. :n , . . . ,Xj^ p:n 
are distributed as order statistics corresponding to a sample of N p i.i.d. r.v.'s with 
distribution function F(x)/p, x < £ p . Though this fact is well known (cf., e.g., Theorem 
12.4, [12], cf. also [8], [TO]), we give a brief proof of it in the section [6j 



3 Proof of Theorem D] 

We can assume with impunity that a 2 < 1/2, i.e. we will prove representation (|2.4p 
for the quantiles at the left edge of the variation series. Then k n < (n — k n ) for all 
sufficiently large n, and so it is enough to prove (|2.4p with 

A„ _ A P T (^) 3 ' 4 %.) + B r )P (^) (C). (3.1) 

We begin with the proof of the first assertion of the theorem, where there is no restric- 
tions on k n in its tending to infinity. 

Let Ui,...,U n denote a sample of independent uniform (0, 1) distributed r.v.'s, and 
Ui: n < • • • < U n:n - the corresponding order statistics. Put 

N^ n = t{i:X i <^ Pn }, N Pn = t{i:U i <p n }, (3.2) 

and note that C P „n-.n = X kn - n (because p n = k n /n). 

We must prove that P(\R n (p n )\ > A n ) = O (k~ c ) for each c > (cf. (f2~4"l) ). and 
since the joint distribution of X kn :n, N pn coincide with joint distribution of i ?_1 (f/fc n:n ), 
N Pn it is suffices to verify it for a remainder given by 

R n ( Pn ) = G(F-\U kn .. n )) - G(F-\ Pn )) + N ^- pnn ^ p J. 

Since P(U kn - n ^ U) = 0(exp(—5n)) for some 5 > not depending on n, we can rewrite 
Rn{Pn) for all sufficiently large n as 

ji^Pn) Rn,i + Rn,2, (3.3) 

where R nA = U kn , n - p n + and R n , 2 = (f (P- X (pn + 0(tf fc „ : „ - Pn))) 

— j {F~ l (p n )) S j{Uk n :n — Pn) 5 < < 1. Fix an arbitrary c > and note that we 

1 /2 

can estimate R n ,j, j = 1,2, on the set .E = {w : |A / Pn — p n n| < Ao(p n n log£; n ) }, 
where Aq is a positive constant, depending only on c, because by Bernstein inequality 
P(fi \E) = 0(k~ c ) (in fact we can take every A : > 2c). We will prove that 

P(|iM > A 1 {p n ) 1 /\\ogk n /nf/ A ) = 0(k~ c ) (3.4) 
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and that 



P{\Rn,2\ > A 2Pn ^ pn z(C)(\0gk n /k n ) 1 / 2 ) = 0(k- C ). 



(3.5) 



Here and elsewhere A4 ,i = 1, 2, . . . , and C denote some positive constants, depending 
only on c. Relations (|3.3p - (|3,5p imply (|2.4p with A n given in ()3. 1|) . 

First we prove (|3.4p . using a similar conditioning on i\L argument as in proof 
of lemmas 4.1, 4.3 in [8]. First let k n < N Pn , then conditionally on N Pn the 
order statistic U^ n ,_ n is distributed as fc n -th order statistic U' kn . N of the sample 
U[,...,U' Np independent (0,p n ) uniformly distributed r.v.'s (cf. lemma RTTl ap- 
pendix). Its expectation E{Uk n -. n I N Pn , k n < N Pn ) = p n N kn +l , and the conditional 



variance V k 2 



'1 



), and on the set E we have an estimate 
ite 

k n 



N p „+2 N Pn +l \ x N Pn +l 

V 2 < A (p n ) 1/2 n~ 3/2 log 1/2 n. Then rewrite R n ,i (at the event k n < N Pn ) as 



Pn 



N Pn + l 



(3.6) 



where Ri 



L n,l - Pn N Pn +l fn^ n - n (N Pn + l) 

set E the latter quantity is of the order O P^£- 

the remainder term R' n 1 is of negligible order for our purposes. For the first two terms 
in (13.61) we have 



„ , N Pn -p n n _ (N Pn -k n ) 2 N Pn -fen 
Pn t — „/w ±i\ T 



n(N Pn + l) n(N Pn +t) 



tv, and on the 



, and since !s^» = (^f^), 



U> 



k n :n Pn 



> A^pr 



vl/4 



log A; n 



n 



3/4 



iV pn : k n < N Pn 



kn'-N Pn 



Pn 



> Ai(p r 



vl/4 



log k Tl 



3/4 N 



A + P2, 



(3.7) 



where iY Pn is fixed, 



< 



N, 



Pn ■ 



A\ is a constant which we will 



choose later, P x = P ( U' kn . Npn > p n 



AtipnY 



1/4 / log k n 



n 3/4 



3/4 



is similar. Consider a binomial r.v. 5; = ^=7 1 |TJ , <n kn , A , )1/4(logkn ^ ■> 



. We evaluate Pi , the treatment for P2 



} 



with parameter (q n ,N Pn ), where q n = min(l, N kn +1 + t n ), where t n = A\ ' log kn 



3/4 

1 

y Pn^ L ' ' \ k n 

If q n = 1, then P\ = and the inequality we need is valid trivial. Let q n < 1 and let 
S' n denote the average S' n /N Pn , then the probability P\ is equal to 



P(S' n <k n )=P( S' n -q n < 



k r , 



kn 



N, 



Pn 



N Pn + l 



(3.8) 



Note that 



o [ t n k<> 



-1/4 



< — , and since the latter quantity is 
o(t n ) on the set E, this term can be omitted at the r.h.s. of (13. 8p in our 



estimating. To evaluate P (S' n — q n < —tn) we note that q n — t n 



3 G (0,1), and 



that q n > 1/2 for all sufficiently large n (and hence k n and iV„ n ) on the set E. So, we may 
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apply an inequality (2.2) of Hoeffding [IT] with fx = q n and with g{p) = 1/(2^(1 — //)). 
Then we obtain 

P(S' n < k n ) < exp (-N p Xg( qn )) = exp L ^^IJ^ ) . (3 . 9 ) 

\ ^<in\^ Qn) I 

Finally we note that 1 - q n = 1 - - Ai (^^f^) < ^n^+i" , and on the 

set E the latter quantity is not greater than A o( k n^s k n) 1 ^ Then we can get a low 

1 , r U ■ To-fTTi ^^(logfcn/fcn) 372 A? N 2 „ (log fc„/fe n ) ^ 

bound lor the ratio at the r.h.s. m 03.9 : ^-St — > — n r 77 , — , rrfe — = 

2^1og/c n (1**) = 2^1og/c n (1 + o(l)). This bound and ([3J| together yield that 

A 2 

when 2^ > c the desired relation Pi = 0(k~ c ) hold true. The same estimate is valid 
for P 2 . 

A 2 

Note that the condition ^r- > c which we needed to establish the desired estimates 

2Ao — 

A 2 

can be weakened to 7^ > c — 1/2 > if we apply a refinement of Heoffding's inequality 
due to Talagrand [20J (cf. also Leon and Perron [16]). However the improvement is not 
very useful here, as applying Talagrand's inequality instead of Hoeffding,s only affects 
the constant, but not the order bound in our setting. 

In case N Pn < k n we use the fact that Uk n -. n conditionally on N Pn is distributed as 
(k n —N Pn )-th order statistic _ N . n _ N of the sample U", . . . , U"_ N from (1— p n , 1) 

uniform distribution, its expectation is p n + n "^ s +i , and for the conditional variance we 

have the estimate V 2 _ N < Aq (p n log k n ) 1 / 2 n~ 3 / 2 . In this case we use a representation 

for R nA = R» tl + K >2 , where R'; a = U kn:n - Pn - ^^ (1 - p n ), and R'^ 2 = 

Afp "~ Pn " + n-Np P +i O-~P»)- Simila rly as in first case we obtain that R'^ 2 = 0(^ a ) 
with probability 1 — 0(k~ c ), and this term is of the negligible order in our estimating. 
Using Hoeffding's inequality we obtain for R'^ 1 same estimate as for R' nl . So (|3.4p is 
proved. 

It remains to prove (j3.5[) . First note that by (|3,4p on the set E with probability 1 — 
O(k^) we have \U K:n -p n \ < A V°~**f) 1/2 +A lPn (^t)^ = (p n ^) 1/2 (l+o(l)). 

Thus, there exists A 2 , depending only on c, such that j-Rn.^l < A 2 (p n Xog ^ n } 1 ^ 2 ^> p n ,a.{A 2 ) 

with probability 1 — 0(k~ c ). This implies (|3.5p . Thus, the first assertion of the theo- 
rem [2T] is proved. 

To prove the second assertion, it is sufficient to repeat previous arguments replacing 
log/c„ by logn throughout the proof, and applying the fact \ogn/k n — > (due to [A 2 ]) 
instead of the evident fact that log k n /k n — > used before, moreover now we should use 
the function ^ Pn ,h(C) instead of ^ Pn ,h{C). These replacements lead to estimates with 
probability 0(n~ c ) for each c > 0. The theorem is proved. □ 



4 Proof of theorem 12.21 

We give a detailed proof of the first assertion of Theorem 12.21 To prove the second one 
it is enough to make similar replacements as in the proof of the corresponding part of 
the Theorem 12.11 therefore we omit it. 
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Let Np n and N Pn are given as in (|3.2p . then we can rewrite integral on the l.h.s. of 

m ag s 9 n(N^-k n ) {G{X . n) _ GfeJ); where sgn{x) = x/{xl sgn{0) = 

0. Let us adopt the following notation: for any integer k and m define a set I(k,m) := 
{i : [k A m) + 1 < i < k V m} and let Ei6/ (k , m) (-)< := - fc) £*=(™ Am)+ i(-)i- 

Then we must estimate R n (p n ) = ± E*^^ (G(X i:n ) - G(£ P J) + f(g P ,J 
(cf. (|2.7p ). and similarly as in proof of Theorem 12, II we note that R n (p n ) is distributed 

as 



n 



J^ Pn )Rn,l + Rn,2, (4.1) 



where 



(w p „ -Pnn) 



2 



#n,l — n Y,ieI( kntNpn) ( U i:n Pn) H g^T 
#n,2 = £ E ie / {fcn>JVpn) [f ^ fan + 6>i(l7t:n " Pn)) ~ f ° F" 1 fan)] (tf&n " Pn) , 

0<6i<l, i e'l(k n ,N Pn y 

As well as before (cf. the proof of Theorem I2.ip we can assume with impunity that 
0-2 < 1/2, then we need to prove (|2.7p with 

A „ _ Ap m (!^) 5/4 M &J + (C), (4.2) 

Fix an arbitrary c > and prove that 

P(\Rn,l\ > ^l(pn) 3/4 (log W«) 5/4 ) = 0(k~ c ), (4.3) 

P(|J2n >2 | > ^2Pn (A 2 )) = 0(fc" c ), (4-4) 

where > 0, i = 1, 2, . . . , are some constants, depending only on c. Relations (j4. 1 j) and 
imply ([27f]) with A n as in (|4.2p . Similarly as when proving of Theorem l2.1l it is 

1 /2 

enough to estimate R n ,j, j = 1, 2, on the set E = {u> : \N Pn — p n n\ < Ao(p n n log k n ) }, 
where Ao > is a constant, depending only on c, such that P(fl \ E) = 0(k~ c ). 
First we treat R n i- Note that 



max | U i:n -Pn\ = \ U kn . n -p n \ V | U Npn . n - p n \ V | f/jVj^+lm ~Pn| , 
-P( I Uk n -.n — Pn\ > ^(Pnlogfcn/ra) 1 ^ 2 ) = 0(k~ c ) (cf. proof of Theorem [2J]) , and for 



J = iVp„:n ,iVp n:ri +l simultaneously we have P(J U j:n -p n \ > A^-^S^j < P\U Npn+ i :n - 

U Npn . n > = P(u 1:n > A^) = (l-A^Y = 0(k~ c ) for A x > c. Since 

login = o( ^1^^1/2 ? on the set £ we obtain 

|fln,2| < (^)^(p.nlogfc„) 1/2 (^i^) 1/2 = ^^* Pnf (A,) 
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with probability 1 — 0(k~ c ), and (|4.4p is proved. 

Finally, consider i? n ,i- Note that conditionally on N Pn , k n < N Pn , the order statistics 
Ui-.n, k n < i < N Pn , are distributed as the order statistics U[. N from the uniform 
(0,p n ) distribution (cf. proof of theorem 12. ip . their conditional expectations are equal 
to p n Np l + i ■ Then in the case k n < N Pn (the proof for the case N Pn > k n is similar (cf . 
proof of theorem 12. ip with respect to interval (1 — p n , 1), and we omit the details) we 
rewrite R Ut i as 

R ^ = ~ E (Ui:n-Pn W ^ Tl )+R'n,l, (4-5) 
i=k„+l Pn 

p/ _ 1 \^ N Pn _ I i i\ , (N Pn -p n n) 2 _ k n (N Pn -k n )(N Pn -k n -l) 

wnere n n l - - 2^ i=kn+1 p n { Npn+ i ~ *-) H 2^ - 2(iV Pn +i) h 

= (% 2(£v" fcn) - afeffi . and on the set E the latter q uantit y 

is of the order O = (^{p n f /A (to) 5/4 \ Le . R' n l is Q f negligible 

order (cf. (|4.3p ) for our purposes. 

It remains to evaluate the dominant first term on the r.h.s. in (I4.5p . Fix an arbitrary 



ci > c + 1/2, and note that conditional on N Pn the variance of Ui- n (k n + 1 < i < N Pri ) 
is equal to V- 2 = (p n ) 2 N p l +2 N p * +1 ~~ A/pVi ) ' and 011 ^ e se * ^ * s ^ ess * nan 
(pn) 2 Aofcy > fc " )1/2 , and < p n ^ /2 ^ /4 (log^)V4 /iVpn < A^n^Wn) 1 / 4 < 

Pn 

yl^ 2 (p n ) 1//4 n -3 / 4 (log fcn) 1 / 4 . Using Hoeffding's inequality (similarly as in proof of the- 
orem 12. ip , we find that 



P(\Ui:n-Pnj r -^j\ > A 1 ( Pn ) 1/4 (log k n /n) N Pn : k n < N Pn ) = 0(k~ c ) , 
where A\ depends only on c\ (in fact it is true for every A\ such that Af > 2^4o c )- Thus 



Pi 



(Ui-.n-Pn^f — ) | > A)^l (Pn) (log/c n /n) v 



'Pn ' "71 — x "Pn 



< A (k n logk n ) 1 ^ 2 0(k~ Cl ) = 0(k~ c ) . (4.6) 

Combining ()4.5|) f)4.6|) and similar estimates for the case N Pn < k n , arrive at ()4.3p . The 
theorem is proved. □ 



5 Proof of Corollary [2J2 

Suppose for definiteness that p n — > 0, as n — >■ 00, then we must prove the relations: 

Let log(-) denote log k n when we prove a first of relations (|5.ip and log n when we prove 
the second one. Since we will need only that log(-)/A; n — > 0, what is evident in the first 
case and is valid by [A2] in the second one, this notation will allow us to prove each of 
desired assertions simultaneously. 
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Define x n = F (p n ), which tend to — oo, as n — > oo. Fix C > and for a fixed 



t: \t\<C, put Ax n = F~ l (pn + tJpn 



log(-) 



X n = F~ 1 [ P n[l + t 



First we prove that ±p -> 0, as n — > oo. Due to smoothness condition LAi] for 

1 



all sufficiently large n we may write 



log(-) 



f[F~ 1 



t\p 



log(-) 



where < 6 < 1, and since due to regular- 



ity condition we have f(x n )x n ~ —^F{x n ) = —jp n , as x n — > — oo (cf., e.g., Bingham 

1 f(F'HPn)) 



et al. [2j), the latter quantity is equivalent to 



IPr, 



f [F-l p„{l+o(l) 



1 /(^(Pn)) 
7 



f(F-i(p n (l+o(l) 



log(0 



1 + 



/^- 1 ( P n(l+o(l)) 

o(l). Since / G SHr^, for all x < x < we have /(a?) = |x|-( 1+ t)L(x), 
where L(x) is a slowly varying in — oo positive function. Moreover, the inverse 
function F~ 1 (u) is regular varying at zero, i.e. = Li(u), where 

L\(u) is a correspondent slowly varying at zero function. So, for sufficiently large 



n we have f^ F — 

/Un(l+o(l)) 



Pn 1/7 il(Pn)l <1 + 7) L(F-l(Pn)) 



L(F-i(p„(l+o(l)))) 



(p„(l+o(l))) 7 L 1 ( Pn (l+o(l))) 

1. Thus 



"(1 + 7) 



L^-^a+oW))) 



i|p™ 1/7 il(Pn) 



i°g()Y 



i (p„(l+o(l))) 1/7 Li(p„(l+o(l))) 

Finally, we obtain a bound for j (x n + Ax n ) — % (x n ) for an arbitrary fixed C > 

and |i| < C, as n — > oo. Due to relation (|2.1ip which holds true for the density / as 
well as for the function g we have 



j. (3*n Ax n ) j. (pn) 

-o( l 4( Xn y f{Xn) 



f(x n )[g(x n + Ax n ) - g(x n )] - g(x n )[f(x n + Ax n ) - f(x n )\ 



f(x n + Ax n )f(x n ) 



f f{x n + Ax r , 



Ax n 



l/2> 



f{Xn) 



f f{Xn) + [/On + Ax n ) - f(x n )] 



Ax n 



1/2^ 



/ 



V 



1 + 



1/2 



At 



1/2 



Ax r 



1/2^ 



A:,, 



as 71 — y 00.. The latter bound yields f)5. 1 j) . The corollary is proved. □ 
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6 Appendix 



Let as before, N p = §{i : Xi < £ p , i = l,...,n}, where < p < 1 is fixed. In 
this appendix we prove that conditionally on N p the order statistics X\- n , . . . ,X^ p:n 
are distributed as order statistics corresponding a sample of N p i.i.d. r.v.'s with distri- 
bution function F(x)/p, x < £ p . Though this fact is essentially known (cf.,e.g., Theo- 
rem 12.4, [12] , cf. also [8] , [10] ) , we add a brief proof of it. Let JJ\ , . . . , U n be independent 
r.v.'s uniformly distributed on (0, 1) and let Ui- n , . . . , U n:n denote the corresponding or- 
der statistics. Put N P)U = : U{ < p, i = 1, . . . ,n}. Since the joint distribution of 
the pair Xi :n , Np is same as joint distribution of F ^(Ui:n)j N PjU , it is enough to prove 
the assertion for the uniform distribution. 

Lemma 6.1 Conditionally given N PjU , the order statistics Ui >n , . . . , Un u ,n « r e dis- 
tributed as order statistics corresponding to a sample of N pu independent (0,p) -uniform 
distributed r.v. 's. 

Proof, a). First consider the case N PtU = n. Take arbitrary < u\ < ■ ■ ■ < u n < p and 
write 

T3(TT / TT ^ I AT \ P ( U l--n < U 1 ,...,U nm < U n ) 

P{Ui;n <«!,.-., U NptU . n < u n | N P:U = n) = 



p" 



P n JO Jui Jun-1 

and the latter is d.f. of the order statistics corresponding to the sample of n independent 
(0,p)-uniform distributed r.v.'s. b). Consider the case N p>u = k < n. Let F iin (u) = 
P(Ui:n < u) be a df of i-th order statistic, put P n (k) = P{N PtU = k) = H)p k (l -p) n ' k . 
Then we have 

D , TT . TT ^ i at m P{Ui:n<u 1 ,...,U k:n <u k ,U k+1:n >p) 

P{Ul:n < Ul, . . . , U NptU :n < U k I N p:U = k) = 



dx\dx2 ■ ■ ■ dx n , 



Pn(k) 

The probability in the nominator on the r.h.s. of (|6.ip is equal to 

l 

P(Ul :n < Ui, ... , U k:n < U k | U k +l:n = v) dF k +l, n (v), 

and by the Markov property of order statistics the latter quantity equals 



(6.1) 



\ ~k / ••• / dxidx 2 ...dx k ) dF k+hn (v) 

Jp \ v JO Jui Ju k _ 1 J 

/•Ui i-u 2 ru k \ f 1 1 

/ / ... / dxidx 2 ...dx k x/ / — dF k+l>n (v) 

Jo Jin Jui—t / Jn v 



k\ ( r ui r 2 r k , , . \ , r 1 i 

'uk-l 

and since p k £ £ dF k+hn (v) = p k ft gffgg^ dv = (> fc (l - p) n ~ k = P n (k), where 
B(k + l,n — k) = k\(n — k — l)\/n\, we obtain that conditional probability in (|6.ip is 
equal 

£| rui ru 2 ru k 

— / . . . / dxidx 2 . ■ . dx k , 

V JO Jui Ju k _i 

which corresponds to the (0,p)-uniform distribution. The lemma is proved. □ 
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